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(57) Abstract 

A display system controls vertical zoom and panning. A video display has a first format display ratio. A circuit (30). for 
example one generating a raster, maps on the video display an adjustable picture display area represented in a video signal hav- 
mg a vertical synchronizing component. The picture represented in the video signal has a second format display ratio. A vertical 
height control circuit (500) for example one controlling the vertical height of the raster by controlling the vertical deflection cur- 
rent, selectively enlarges the picture display area relative to the video display. A panning control circuit (518) adjusts in phase a 
vertical blanking mterval relative to the vertical synchronizing component to control which portion of the enlarged picture area is 
displayed and which portion is not displayed. Hie format display ratios can be the same or different, for example 16 X 9 for the 
video display and 4 X 3 for the picture, in the latter case. 
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VERTICAL ZOOM AND PANNING FOR TELEVISION 
The invention relates to the field of televisions having 
multiple picture displays for asynchronous video signals, and in 
particular, to such televisions having a wide display forn^at ratio 
5 screen. Most televisions today have a format display ratio, 

horizontal width to vertical height, of 4:3. A wide format display 
ratio corresponds more closely to the display format ratio of 
movies, for example 16:9. The invention is applicable to both direct 
view televisions and projection televisions. 

10 Televisions having a format display ratio of 4:3, often referred 

to as 4 X 3, are limited in the ways that single and multiple video 
signal sources can be displayed. Television signal transmissions of 
commercial broadcasters, except for experimental material, are 
broadcast with a 4 X 3 format display ratio. Many viewers find the 

15 4X3 display format less pleasing than the wider format display 
ratio associated with the movies. Televisions with a wide format 
display ratio provide not only a more pleasing display, but are 
capable of displaying wide display format signal sources in a 
corresponding wide display format. Movies "look" like movies, not 

20 cropped or distorted versions thereof. The video source need not be 
cropped, either when converted from film to video, for example with 
a telecine device, or by processors in the television. 

Televisions with a wide display format ratio are also suited to 
a wide variety of displays for both conventional and wide display 

25 format signals, as well as combinations thereof in multiple picture 
displays. However, the use of a wide display ratio screen entails 
numerous problems. Changing the display format ratios of multiple 
signal sources, developing consistent timing signals from 
asynchronous but simultaneously displayed sources, switching 

30 between multiple sources to generate multiple picture displays, and 
providing high resolution pictures from compressed data signals are 
general categories of such problems. Such problems are solved in a 
wide screen television according to this invention. A wide screen 
television according to the various aspects of this invention is 

35 capable of providing high resolution, single and multiple picture 
displays, from single and multiple asynchronous sources having 
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Similar or different format ratios, and with selectable display 
format ratios. 

Almost ail video products currently available to consumers 
have a format display ratio of 4 x 3. whereas the format display 
ratio of video production varies widely. If an aspect ratio greater 
than 4 X 3 is used for video production, an aspect ratio conversion 
must be performed before display on a consumer television or 
picture distortion will occur. One method of aspect ratio conversion 
IS known as letterboxing. Letterboxing maintains more (or all) of 
the horizontal information, at the expense of the number of 
displayed lines in each field. A video source produced in the 16 x 9 
format would contain 181 lines of video each field when converted 
to 3 4x3 letterbox format. The extra lines that are not used in each 
field can be set to a flat field black (or gray) level. Higher aspect 
ratio sources would contain proportionally fewer lines per field 

A wide screen television, as described herein for example can 
have a format display ratio of 16 x 9. This provides an opportunity 
to display signals in the letterbox format with greater flexibility 
Letterbox signals that were originally produced in the 16 x 9 aspect 
ratio may be zoomed, that is expanded, vertically to fill the screen 
With no loss of horizontal information or distortion. An automatic' 
letterbox detector can be based on the assumption that the video 
signal will have no active video, that is. a substantially constant 
luminance value not higher than a threshold value. Alternatively 
letterbox detection can be accomplished by calculating two 
gradients for each line in the video field. The first gradient, 
designated the positive gradient, is formed by subtracting the 
minimum value of the previous line from the maximum value of the 
current line. The second gradient., designated the negative gradient 
IS formed by subtracting the minimum value of the current line from 
the maximum value of the previous line. Either of the gradients may 
have positive or negative values depending on scene content, but the 
negative values of both gradients may be ignored. If either gradient 
has a positive value which exceeds a programmable threshold, video 
IS considered to be present on either the current line or on the 
previous line. These register values can be used by a microprocessor 
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to make a determination of whether or not the video source is in the 
letterbox format. In yet another alternative, not illustrated in the 
drawings, the automatic letterbox detector may comprise a circuit 
for decoding a code word or signal carried by a letterbox signal 
s source which identifies the signal as letterbox format. 

An automatic letterbox detector can form part of a vertical 
size control circuit. The vertical size control circuit comprises a 
letterbox detector and a vertical display control circuit. The 
vertical blanking and vertical reset pulses can be transmitted as 
1 0 separate signals or as a single three level signal. The automatic 
letterbox detection circuit can automatically implement vertical 
zoom or expansion of the 4 x 3 format display ratio signal which 
includes the 16 x 9 format display ratio letterbox display. When the 
output signal becomes active, the vertical deflection height is 
15 Increased by 4/3, which enables the active video portion of the 
letterbox signal to fill the wide screen without image aspect ratio 
distortion. 

In accordance with an inventive arrangement, the vertical 
display control circuit also controls which part of the overscanned 

20 raster will be displayed on the screen, a feature referred to as 

vertical panning. If the vertically overscanned video signal is not in 
letterbox format, the conventional display format picture can be 
zoomed, that is expanded, to simulate a wide screen format. In this 
case, however, the portions of the picture cropped by the 4/3 

25 vertical overscan will contain active video information. It is 
necessary to vertically crop 1/3 of the picture. Absent further 
controls, the top Vs and bottom Vs will always be cropped. 
However, picture content may dictate that more of the top than the 
bottom of the picture is better cropped, or vice versa. If all action 

30 is at ground level, for example, a viewer might prefer to crop more 
sky. A ;^rtical panning capacity enables a choice as to which part of 
the zoor;'.<^d picture will be shown and which part will be cropped. 

FIGURES 1(a)-1(i) are useful for explaining different display 
formats of a wide screen television. 
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FIGURE 2 is a block diagram of a wide screen television in 
accordance with aspects of this invention and adapted for operation 
at 2fH horizontal scanning. 

FIGURE 3 is a block diagram of the wide screen processor 
shown In FIGURE 2. «^«s5or 

FIGURE 4 is a block diagram showing further details of the 
wide screen processor shown in FIGURE 3. 

FIGURE 5 is a block diagram of the picture-in-picture 
processor shown in FIGURE 4, 

a^r>,Jl^^^^ ® ^ diagram of the gate array shown in 
FIGURE 4 and illustrating the main, auxiliary and output signal 
paths. ^ 

FIGURES 7 and 8 are timing diagrams useful for explaining the 
generation of the display format shown in FIGURE 1(d). using fully 
15 cropped signals. 

FIGURE 9 is a block diagram of a circuit for generating the 
internal 2fH signal in the 1fH to 2fH conversion. 

FIGURE 10 is a combination block and circuit diagram for the 
deflection circuit shown in FIGURE 2. 

JJ^^^^ ^ ^ '^'^^'^'^ °^ Interface shown in 

rlQURE 2. 

FIGURE 12 is a block diagram of a vertical size control circuit 
including an automatic letterbox detector. 

FIGURE 1 3 is a timing diagram useful for explaining 
implementation of vertical panning. 

FIGURES 14(a)-14(c) are diagrams of display formats useful 
for explaining the timing diagram of FIGURE 13. 

The various parts of FIGURE 1 illustrate some, but not all of 
the various combinations of single and multiple picture display 
formats which can be implemented according to different inventive 
arrangements. Those selected for Illustration are intended to 
facilitate the description of particular circuits comprising wide 
screen televisions according to the inventive arrangements For 
purposes of convenience in illustration and discussion herein a 
conventional display format ratio of width to height for a video 
source or signal is generally deemed to be 4 X 3. whereas a wide 
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screen display format ratio of width to height for a video source or 
signal is generally deemed to be 16X9. The inventive 
arrangements are not limited by these definitions. 

FIGURE 1(a) illustrates a television, direct view or projection, 
5 having a conventional format display ratio of 4X3. When a 16X9 
format display ratio picture is transmitted, as a 4X3 format 
display ratio signal, black bars appear at the top and at the bottom. 
This is commonly referred to as letterbox format. In this instance, 
the viewed picture is rather small with respect to the entire 
10 available display area. Alternatively, the 16X9 format display 
ratio source is converted prior to transmission, so that it will fill 
the vertical extent of a viewing surface of 4 X 3 format display. 
However, much information will be cropped from the left and/or 
right sides. As a further alternative, the letterbox picture can be 
IS expanded vertically but not horizontally, whereby the resulting 

picture will evidence distortion by vertical elongation. None of the 
three alternatives is particularly appealing. 

FIGURE Kb) shows a 16X9 screen. A 16X9 format display 
ratio video source would be fully displayed, without cropping and 
20 without distortion. A 16X9 format display ratio letterbox 

picture, which is itself In a 4 X 3 format display ratio signal, can 
be progressively scanned by line doubling or line addition, so as to 
provide a larger display with sufficient vertical resolution. A wide 
screen television in accordance with this invention can display such 
25 a 16X9 format display ratio signal whether the main source, the 
auxiliary source or an external RGB source. - 

FIGURE 1(c) illustrates a 16 X9 format display ratio main 
signal In which a 4 X 3 format display ratio inset picture is 
displayed. If both the main and auxiliary video signals are 16X9 
30 format display ratio sources, the inset picture can also have a 

16X9 format display ratio. The inset picture can be displayed in 
many different positions. 

FIGURE 1(d) illustrates a display format, wherein the main and 
auxiliary video signals are displayed with the same size picture. 
3s Each display area has an format display ratio of 8X9. which is of 
course different from both 16X9 and 4X3. In order to show a 
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4X3 format display ratio source in such a display area, without 
horizontal or vertical distortion, the signal must be cropped on the 
left and/or right sides. More of the picture can be shown, with less 
cropping, if some aspect ratio distortion by horizontal squeezing of 
the picture is tolerated. Horizontal squeezing results in vertical 
elongation of objects in the picture. The wide screen television 
according to this invention can provide any mix of cropping and 
aspect ratio distortion from maximum cropping with no aspect ratio 
distortion to no cropping with maximum aspect ratio distortion. 

Data sampling limitations in the auxiliary video signal 
processing path complicate the generation of a high resolution 
picture which is as large in size as the display from the main video 
signal. Various methods can be developed for overcoming these 
complications. 

FIGURE 1(e) is a display format wherein a 4X3 format 
display ratio picture is displayed in the center of a 16X9 format 
display ratio screen. Dark bars are evident on the right and left 
sides. 

FIGURE 1(f) illustrates a display fomiat wherein one large 
4X3 format display ratio picture and three smaller 4X3 format 
display ratio pictures are displayed simultaneously. A smaller 
picture outside the perimeter of the large picture is sometimes 
referred to as a POP. that is a plcture-outside-picture. rather than a 
PIP. a picture-in-picture. The terms PIP or picture-in-picture are 
used herein for both display formats. In those circumstances where 
the wide screen television is provided with two tuners, either both 
internal or one internal and one external, for example in a video 
cassette recorder, two of the displayed pictures can display 
movement In real time in accordance with the source. The remaining 
pictures can be displayed in freeze frame format. It will be 
appreciated that the addition of further tuners and additional 
auxiliary signal processing paths can provide for more than two 
moving pictures. It will also be appreciated that the large picture 
on the one hand, and the three small pictures on the other hand, can 
be switched In position, as shown in FIGURE 1(g). 
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FIGURE 1(h) Illustrates an alternative wherein the 4X3 
format display ratio picture is centered, and six smaller 4X3 
format display ratio pictures are displayed in vertical columns on 
either side. As in the previously described format, a wide screen 
5 television provided with two tuners can provide two moving 
pictures. The remaining eleven pictures will be in freeze frame 
format. 

FIGURE 1(1) shows a display format having a grid of twelve 
4X3 format display ratio pictures. Such a display format is 
0 particularly appropriate for a channel selection guide, wherein each 
picture is at least a freeze frame from a different channel. As 
before, the number of moving pictures will depend upon the number 
of available tuners and signal processing paths. 

The various formats shown in FIGURE 1 are illustrative, and 
5 not limiting, and can be implemented by wide screen televisions 
shown in the remaining drawings and described in detail below. 

An overall block diagram for a wide screen television in 
accordance with inventive arrangements, and adapted to operate 
with 2fH horizontal scanning, is shown in FIGURE 2 and generally 
designated 10. The television 10 generally comprises a video 
signals input section 20, a chassis or TV microprocessor 216, a ' 
wide screen processor 30, a 1fH to 2fH converter 40. a deflection 
circuit 50. an RGB interface 60, a YUV to RGB converter 240. kine 
drivers 242, direct view or projection tubes 244 and a power supply 
70. The grouping of various circuits into different functional blocks 
is made for purposes of convenience in description, and is not 
intended as limiting the physical position of such circuits relative 
to one another. 

The video signals input section 20 is adapted for receiving a 
plurality of composite video signals from different video sources: 
The video signals may be selectively switched for display as main 
and auxiliary video signals. An RF switch 204 has two antenna 
inputs ANT1 and ANT 2. These represent inputs for both off-air 
antenna reception and cable reception. The RF switch 204 controls 
which antenna input is supplied to a first tuner 206 and to a second 
tuner 208. The output of first tuner 206 is an input to a one-chip 
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202. Which performs a number of functions related to tuning 
horizontal and vertical deflection and video controls. The particular 
one-chip shown is Industry designated type TA7730. The baseband 
video signal VIDEO OUT developed in the one-chip and resulting from 

InH Tt^T"" ^" '"P"^ ^° ^'^eo switch 200 

and the TVI input of wide screen processor 30. Other baseband 
video inputs to video switch 200 are designated AUX1 and AUX 2 
These might be used for video cameras, laser disc players video 
tape players, video games and the like. The output of the video 
switch 200. which is controlled by the chassis or TV microprocessor 
216 IS designated SWITCHED VIDEO. The SWITCHED VIDEO is another 
input to wide screen processor 30. 

With further reference to FIGURE 3. a switch SWI wide screen 
SfT COMP n^fx 'r'^" ^"^ SWITCHED VIDEO signals as a 

?K v,^ . """^^^ ^" '"P"^ t° a Y/C decoder 210 

The Y/C decoder 210 may be implemented as an adaptive line comb 
^Iter. Two further video sources Si and S2 are also inputs to the 
Y/C decoder 210. Each of Si and S2 represent different S-VHS 
sources, and each consists of separate luminance and chrominance 
signals. A switch, which may be incorporated as part of the Y/C 
decoder, as in some adaptive line comb filters, or which may be 
implemented as a separate switch, is responsive to the TV 
microprocessor 216 for selecting one pair of luminance and 
Chrominance signals as outputs designated Y_M and CJN 
respectively. The selected pair of luminance and chrominance 
signals .s thereafter considered the main signal and is processed 
along a main signal path. Signal designations including _M or MN 
refer to the main signal path. The chrominance signal C IN is 
redirected by the wide screen processor back to the one"chip for 
developing color difference signals U_M and V.M. In this regard U is 
an equivalent designation for (R-Y) and V is an equivalent 

tn'^lTf ? ""'^ '''''' ^"^ ^'S^^'s converted 

to digital form m the wide screen processor for further signal 
processing. ^ 

The second tuner 208, functionally defined as part of the wic« 
screen processor 30. develops a baseband video signal TV2. A 
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switch SW2 selects between the TV2 and SWITCHED VIDEO signals 
as an Input to a Y/C decoder 220. The Y/C decoder 220 may be 
implemented as an adaptive line comb filter. Switches SW3 and SW4 
select between the luminance and chrominance outputs of Y/C 
5 decoder 220 and the luminance and chrominance signals of an 

external video source, designated Y_EXT and C^EXT respectively. The 
Y_EXT and C_EXT signals correspond to the S-VHS input Si The Y/C 
decoder 220 and switches SW3 and SW4 may be combined, as in some 
adaptive line comb filters. The output of switches' SW3 and SW4 Is 
10 thereafter considered the auxiliary signal and is processed along an 
auxiliary signal path. The selected luminance output Is designated 
Y_A. Signal designations Including _A. _AX and _AUX refer to the 
auxiliary signal path. The selected chrominance is converted to 
color difference signals U_A and V_A. The Y_A. U A and V A signals 
15 are converted to digital form for further signal processing "The 
arrangement of video signal source switching in the main and 
auxiliary signal paths maximizes flexibility in managing the source 
selection for the different parts of the different picture display 
formats. ^ 

^° X/ composite synchronizing signal COMP SYNC, corresponding to 
Y_M IS provided by the wide screen processor to a sync separator . 
212. The horizontal and vertical synchronizing components H and V 
respectively are inputs to a vertical countdown circuit 214 The 
vertical countdown circuit develops a VERTICAL RESET signal which 
25 IS directed into the wide screen processor 30.. The wide screen 
processor generates an internal vertical reset output signal INT 
VERT RST OUT directed to the RGB interface 60. A switch In the RGB 
interface 60 selects between the internal vertical reset output 
signal and the vertical synchronizing component of the external RGB 
30 source. The output of this switch Is a selected vertical 

synchronizing component SEL.VERT^SYNC directed to the deflection 
circuit 50. Horizontal and vertical synchronizing signals of the 
auxiliary video signal are developed by sync separator 250 In the 
wide screen processor. 
35 The 1fH to 2fH converter 40 is responsible for converting 

interlaced video signals to progressively scanned noninterlaced 
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Signals, for example one wherein each horizontal line is displayed 
twice, or an additional set of horizontal lines is generated by 
interpolating adjacent horizontal lines of the same field In some 
instances the use of a previous line or the use of an interpolated 
line will depend upon the level of movement which is detected 
between adjacent fields or frames. The converter circuit 40 
operates m conjunction with a video RAM 420. The video RAM may 
be used to store one or more fields of a frame, to enable the 
progressive display. The converted video data as Y_2fH. U_2fH and 
V^2fH signals is supplied to the RGB interface 60. 

The RGB interface 60. shown in more detail in FIGURE 1 1 
enables selection of the converted video data or external RGB video 
data or display by the video signals input section. The external RGB 
signal is deemed to be a wide format display ratio signal adapted for 
2fH scanning. The vertical synchronizing component of the main 

^'^""^^rlilT'^ '° '"'^^^^^ ^'^^ s^^een processor 

as INT VERT RST OUT. enabling a selected vertical sync (fv' or fve.t) 
to be available to the deflection circuit 50. Operation of the wide 
screen television enables user selection of an external RGB signal 
by generatmg an internal/external control signal INT/EXT However 
the selection of an external RGB signal input, in the absence of such' 
a signal, can result in vertical collapse of the raster, and damage to 
the cathode ray tube or projection tubes. Accordingly, the RGB 
interface circuit detects an external synchronizing signal, in order 
to override the selection of a non-existent external RGB input The 
WSP microprocessor 340 also supplies color and tint controls for 
the external RGB signal. 

The wide screen processor 30 comprises a picture in picture 
processor 320 for special signal processing of the auxiliary video 
signal. The term picture-in-picture is sometimes abbreviated as 
PIP or pix-in-pix. A gate array 300 combines the main and auxiliary 
video signal data in a wide variety of display formats, as shown by 
the examples of FIGURES 1(b) through The picture-in-picture 
processor 320 and gate array 300 are under the control of a wide 
screen microprocessor (WSP ^iP) 340. Microprocessor 340 is 
responsive to the TV microprocessor 216 over a serial bus The 
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serial bus includes four signal lines, for data, clock signals, enable 
signals and reset signals. The wide screen processor 30 also 
generates a composite vertical blanking/reset signal, as a three 
level sandcastle signal. Alternatively, the vertical blanking and 
5 reset signals can be generated as separate signals. A composite 
blanking signal is supplied by the video signal input section to the 
RGB interface. 

The deflection circuit 50, shown in more detail in FIGURE 10, 
receives a vertical reset signal from the wide screen processor, a 
0 selected 2fH horizontal synchronizing signal from the RGB interface 
60 and additional control signals from the wide screen processor. 
These additional control signals relate to horizontal phasing, 
vertical size adjustment and east-west pin adjustment. The 
deflection circuit 50 supplies 21h flyback pulses to the wide screen 
5 processor 30, the 1fH to 2fH converter 40 and the YUV to RGB 
converter 240. 

Operating voltages for the entire wide screen television are 
generated by a power supply 70 which can be energized by an AC 
mains supply. 

The wide screen processor 30 is shown in more detail in 
FIGURE 3. The principal components of the wide screen processor 
are a gate array 300, a picture-in-picture circuit 301, analog to 
digital and digital to analog converters, the second tuner 208, a 
wide screen processor microprocessor 340 and a wide screen output 
encoder 227, Further details of the wide screen processor are 
shown In FIGURE 4. A picture-in-picture processor 320, which 
forms a significant part of the PIP circuit 301. is shown in more 
detail in FIGURE 5. The gate array 300 is shown in more detail in 
FIGURE 6. A number of the components shown in FIGURE 3 have 
already been described in detail. 

The second tuner 208 has associated therewith an IF stage 224 
and an audio stage 226. The second tuner 208 also operates in 
conjunction with the WSP ^P 340. The WSP nP 340 comprises an 
input output I/O section 340A and an analog output section 340B. 
The I/O section 340A provides tint and color control signals, the 
INT/EXT signal for selecting the external RGB video source and 
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control signals for »e switches SW1 through SW6. The I/O section 
also momtors the EXT SYNC DET signal from the RGB interface to 
protect the deflection circuit and cathode ray tube(s). The analog 
output sect,on 3406 provides control signals for venical size east- 
west ad,ust and horizontal phase, through respective interface 
circuits 254. 258 and 258. 'ntertace 

The gate array 300 Is responsible for combining video 

composite wide screen display, for example one of those shown in 
the different parts of FIGURE 1. Clock information for the gate array 
■s provided Phase locked loop 374, which operates in Lnfunc« n 
with low pass filter 376. The main video signal is supplied {oThe 
Wide screen processor in analog form, and Y U V format, as signals 

f^om ? . f-y-*" conve'e^ 
from analog to digital fom, by analog to digital converters 342 and 
346, shown m more detail in FIGURE 4. 

The color component signals are referred to by the aeneric 
designations U and V, which may be assigned to either R-Y or B-Y 

limited to 8 MHz because the system clock rate is l024fH which is 

analog switch can be used to sample the color component data 
berause the U and V signals are limited to 500 KHz. or 1.5 MHz for 

Jl r, I? - ^ ^y^^"< =10* by 2. A 

one clock wide start of line SOL pulse synchronously resets this 

,11 r'™ "eginning of each horizontal video line. The 

UV_MUX line than toggles in state each clock cycle through the 
horizontal line. Since the line length is an even number of clock 

to^ta n f °' '"'«^«"^' consistently 

toggle 0, 1. 0. i without interruption. The Y and UV data 

streams out of the analog to digital converters 342 and 346 are 

Shifted because the analog to digital converters each have 1 clock 

qrele of delay. In order to accommodate for this data shift the 

clock gating InformaMon from the main signal processing p'ath 304 

must be similarly delayed. Were the ctook gating information not 
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delayed, the UV data will not be correctly paired when deleted This 
IS important because each UV pair represents one vector. A U 
element from one vector cannot be paired with a V element from 
another vector without causing a color shift. Instead, a V sample 
from a previous pair will be deleted along with the current U sample 
This method of UV multiplexing is referred to as 2:1:1. as there are 
two luminance samples for every pair of color component (U V) 
samples. The Nyquist frequency for both U and V is effectively 
reduced to one half of the luminance Nyquist frequency. Accordingly 
the Nyquist frequency of the output of the analog to digital 
converter for the luminance component is 8 MHz, whereas the 
Nyquist frequency of the output of the analog to digital converter for 
the color components is 4 MHz. 

The PIP circuit and/or the gate array may also include means 
for enhancing the resolution of the auxiliary data notwithstanding 
the data compression. A number of data reduction and data 
restoration schemes have been developed, including for example 
paired pixel compression and dithering and dedlthering. Moreover 
different dithering sequences involving different numbers of bits' 
and different paired pixel compressions involving different numbers 
of bits are contemplated. One of a number of particular data 
reduction and restoration schemes can be selected by the WSP jiP 
340 in order to maximize resolution of the displayed video for each 
particular kind of picture display format. 

The gate array includes interpolators which operate in 
conjunction with line memories, which may be implemented as 
FIFO's 356 and 358. The interpolator and FIFO's are utilized to 
resample the main signal as desired. An additional interpolator can 
resample the auxiliary signal. Clock and synchronizing circuits in 
the gate array control the data manipulation of both the main and 
auxiliary signals, including the combination thereof into a single 
output video signal having Y_MX. U.MX and V_MX components. These 
output components are converted to analog form by digital to analog 
converters 360. 362 and 364. The analog form signals, designated Y 
U and V. are supplied to the Uh to 2fH converter 40 for conversion 
to noninterlaced scanning. The Y. U and V signals are also encoded -c 
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Y/C format by encoder 227 to define a wide format ratio output 
signal Y_OUT_EXT/C_OUT.EXT available at panel jacks. Switch SW5 
se ects a synchronizing signal for the encoder 227 from either the 
gate array. C^SYNC^MN. or from the PIP circuit. C_SYNC AUX 

^"^ C.SYNC.AUX as s"ynch;onizlng 
srgnal for the wide screen panel output. 

Portions of the horizontal synchronizing circuit are shown in 
more detail in FIGURE 9. Phase comparator 228 is part of a phase 
locked loop including low pass filter 230. voltage controlled 
oscillator 232. divider 234 and capacitor 236. The voltage 
controlled oscillator 232 operates at 32fH. responsive to a ceramic 
resonator or the like 238. The output of the voltage controlled 
oscillator is divided by 32 to provide a proper frequency second 
input signal to phase comparator 228. The output of the divider 234 
-s a 1fH REF timing signal. The 32fH REF and 1fH REF timing signals 
are supplied to a divide by 16 counter 400. A 2fH output is supplied 
to a pulse width circuit 402. Presetting divider 400 by the Ifu REF 
signal assures that the divider operates synchronously with the 
phase locked loop of the video signals input section. Pulse width 
circuit 402 assures that a 2fH.REF signal will have an adequate 
pulse width to assure proper operation of the phase comparator 404 
or example a type CA1391. which forms part of a second phase 
locked loop including low pass filter 406 and 2fH voltage controlled 
oscillator 408. Voltage controlled oscillator 408 generates an 
internal 2fH timing signal, which is used for driving the 
progressively scanned display. The other input signal to phase 
comparator 404 is the 2fH flyback pulses or a timing signal related 
thereto. The use of the second phase locked loop including phase 
comparator 404 is useful for assuring that each 2fH scanning period 
IS symmetric within each 1fH period of the input signal. Otherwise 
the display may exhibit a raster split, for example, wherein half of 
the video lines are shifted to the right and half of the video lines are 
shifted to the left. 

The deflection circuit 50 is shown in more detail in FIGURE 10 
A circuit 500 is provided for adjusting the vertical size of the 
raster, in accordance with a desired amount of vertical overscan 
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necessary for implementing different display formats. As 
illustrated diagrammatically, a constant current source 502 
provides a constant quantity of current Iramp which charges a 
vertical ramp capacitor 504. A transistor 506 is coupled in parallel 
with the vertical ramp capacitor, and periodically discharges the 
capacitor responsive to the vertical reset signal. In the absence of 
any adjustment, current Iramp provides the maximum available 
vertical size for the raster. This might correspond to the extent of 
vertical overscan needed to fill the wide screen display by an 
expanded 4X3 format display ratio signal source, as shown in 
FIGURE 1(a). To the extent that less vertical raster size is required, 
an adjustable current source 508 diverts a variable amount of 
current Iaoj from Iramp. so that vertical ramp capacitor 504 charges 
more slowly and to a smaller peak value. Variable current source 
508 is responsive to a vertical size adjust signal, for example in 
analog form, generated by vertical size control circuit 1030 shown 
in FIGURE 12. Vertical size adjustment 500 is independent of a 
manual vertical size adjustment 510, which may be implemented by 
a potentiometer or back panel adjustment knob. In either event, the 
vertical deflection coil(S) 512 receive(s) driving current of the 
proper magnitude. Horizontal deflection is provided by phase 
adjusting circuit 518. East- West pin correction circuit 514. a 2fH 
phase locked loop 520 and horizontal output circuit 516. 

The RGB interface circuit 80 is shown in more detailed in 
25 FIGURE 11. The signal which is to be ultimately displayed will be 
selected between the output of the Ifn to 2fH converter 40 and an 
external RGB input. For purposes of the wide screen television 
described herein, the external RGB input is presumed to be a wide 
format display ratio, progressively scanned source. The external 
RGB signals and a composite blanking signal from the video signals 
input section 20 are inputs to an RGB to Y U V converter 610. The 
external 2fH composite synchronizing signal for the external RGB 
signal is an input to external synchronizing signal separator 600. 
Selection of the vertical synchronizing signal is implemented by 
switch 608. Selection of the horizontal synchronizing signal is 
implemented by switch 604. Selection of the video signal is 
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implemented by switch 606. Each of the switches 604. 606 and 608 
IS responsive to an internal/external control signal generated by the 
WSP iiP 340. Selection of internal or external video sources is a 
user selection. However, if a user inadvertently selects an external 
RGB source, when no such source is connected or turned on. or If the 
external source drops out. the vertical raster will collapse and 
serious damage to the cathode ray tube(s) can result. Accordingly 
an external synchronizing detector 602 checks for the presence of an 
external synchronizing signal. In the absence of such a signal a 
switch override control signal is transmitted to each of switches 
604, 606 and 608. to prevent selection of the external RGB source if 
the signal therefrom is not present. The RGB to YUV converter 610 
also receives tint and color control signals from the WSP 340. 

FIGURE 4 is a block diagram showing further details of the 
wide screen processor 30 shown in FIGURE 3. The Y^A U_A and V A 
signals are an Input to the picture In picture processor 320. which 
can include a resolution processing circuit 370. The wide screen 
television according to aspects of this invention can expand and 
compress video. The special effects embodied by the various 
composite display formats illustrated in part in FIGURE 1 are 
generated by the picture-in-plcture processor 320. which can 
receive resolution processed data signals Y_RP. U.RP and V^RP from 
resolution processing circuit 370. Resolution processing need not be 
utilized at all times, but during selected display formats The 
picture-in-plcture processor 320 is shown in more detail in FIGURE 
5. The principal components of the picture-in-picture processor are 
an analog-to-digital converter section 322, an input section 324 a 
fast switch (FSW) and bus section 326. a timing and control section 
328 and a digital-to-analog converter section 330. 

The picture-in-picture processor 320 may be embodied as an 
improved variation of a basic CPIP chip developed by Thomson 
Consumer Electronics. Inc. The basic CPIP chip is described more 
fully m a publication entitled The CTC 140 Picture in Picture (CPIP) 
Technical Training Manual, available from Thomson Consumer 
Electronics. Inc.. Indianapolis. Indiana. A number of special features 
or special effects are possible, the following being illustrative. The 
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basic special effect is a large picture having a small picture 
overlaying a portion thereof as shown in FIGURE 1(C). The large and 
small pictures can result from the same video signal, from different 
video signals and can be interchanged or swapped. Generally 
5 speaking, the audio signal is switched to always correspond to the 
big picture. The small picture can be moved to any position on the 
screen or can step through a number of predetermined positions A 
zoom feature increases and decreases the size of the small picture 
for example to any one of a number of preset sizes. At some point ' 
10 for example the display format shown in FIGURE 1(d). the large and 
small pictures are in fact the same size. 

In a single picture mode, for example that shown in FIGURES 
1(b). 1(e) or 1(f) a user can zoom in on the content of the single 
picture, for example, in steps from a ratio of 1.0:1 to 5.0:1. While in 
1 5 the zoom mode a user may search or pan through the picture content 
enabling the screen image to move across different areas of the 
picture. In either event, either the small picture or the large picture 
or the zoomed picture can be displayed in freeze frame (still picture 
format). This function enables a strobe format, wherein the last 
20 nine frames of video can be repeated on the screen. The frame 

repetition rate can be changed from thirty frames per second to zero 
frames per second. 

The picture-in-plcture processor used in the wide screen 
television according to another inventive arrangement differs from 

is the present configuration of the basic CPIP chip described above. If 
the basic CPIP chip were used with a television having a 16 X 9 
screen, and without a video speed up circuit, the inset pictures 
would exhibit aspect ratio distortion, due to the effective 4/3 times 
horizontal expansion resulting from scanning across the wider 

10 16X9 screen. Objects In the picture would be horizontally 

elongated. If an external speed up circuit were utilized, there would 
be no aspect ratio distortion, but the picture would not fill the 
entire screen. 

Existing picture-in-picture processors based on the basic 
5 CPIP chip as used in conventional televisions are operated in a 
particular fashion having certain undesirable consequences. The 
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.ncoming video is sampled with a 640fH clock which is locked to the 
honzontal synchronizing signal of the main video source In other 
words, data stored in the video RAM associated with the CPIP chip is 
not orthogonally sampled with respect to the incoming auxiliary 
video source. This is a fundamental limitation on the basic CPIP 
method of field synchronization. The nonorthogonal nature of the 
input sampling rate results in skew errors of the sampled data The 
limitation is a result of the video RAM used with the CPIP chip 
which must use the same clock for writing and reading data. When 
data from the video RAM. such as video RAM 350. is displayed the 
Skew errors are seen as random jitter along vertical edges of' the 
picture and are generally considered quite objectionable 

The picture-in-picture processor 320. according to an 
inventive arrangement and unlike the basic CPIP chip, is adapted for 
asymmetrically compressing the video data in one of a plurality of 
selectable display modes. In this mode of operation, the pictures 

d[recti«7'^TH^'' ^'^ ^"^ vertical 

direction. Th.s asymmetric mode of compression produces aspect 

'^IrtT''^'' ^''''"'^! "AM- Objects in the 

pictures are squeezed horizontally. However. If these pictures are 
read out normally, as for example in the channel scan mode for 

™ °TH ''''' ^'"^'^^ '"^^ P'-tures appear 

correct. The picture fills the screen and there is no aspect ratio 
distortion. The asymmetric compression mode according to this 
aspect of the invention makes it possible to generate the special 
display formats on a 16X9 screen without external speed up 
circuitry. ^ 

In full screen PIP modes, the picture-in-picture processor in 
conjunction with a free running oscillator 348 will take Y/C input 
from a decoder, for example an adaptive line comb filter, decode the 
signal into Y. U. V color components and generate horizontal and 
vertical sync pulses. These signals are processed in the picture-in- 
picture processor for the various full screen modes such as zoom 
freeze and channel scan. During the channel scan mode, for example 
the honzontal and vertical sync present from the video signals inp. • 
section will have many discontinuities because the signals samplec 
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(different channels) will have non-related sync pulses and will be 
switched at seemingly random moments in time. Therefore the 
sample clock (and read/write video RAM clock) is determined by the 
free running oscillator. For freeze and zoom modes, the sample 
5 clock will be locked to incoming video horizontal sync, which in 
these special cases is the same as the display clock frequency 

Referring again to FIGURE 4. Y. U. V and C_SYNC (composite 
sync) outputs from the picture-in-picture processor in analog form 
can be re-encoded into Y/C components by encode circuit 366 which 
10 operates in conjunction with a 3.58 MHz oscillator 380. This' 
Y/C_PIP_ENC signal may be connected to a Y/C switch, not shown 
which enables the re-encoded Y/C components to be substituted for 
the Y/C components of the main signal. From this point on the PIP 
encoded Y. U. V and sync signals would be the basis for horizontal 
15 and vertical timing in the rest of the chassis. This mode of 

operation is appropriate for implementing a zoom mode for the PIP 
based upon operation of the interpolator and FIFO's in the main 
signal path. 

With further reference to FIGURE 5. the picture-in-picture 
20 processor 320 comprises analog to digital converting section 322 
mput section 324. fast switch FSW and bus control section 326 
timing and control section 328 and digital to analog converting ' 
section 330. In general, the picture-in-picture processor 320 
digitizes the video signal into luminance (Y) and color difference 
5 signals (U. V). subsampling and storing the results in a 1 megabit 
video RAM 350 as explained above. The video RAM 350 associated 
with the picture-in-picture processor 320 has a memory capacity of 
1 megabit, which is not large enough to store a full field of video 
data with 8-bit samples. Increased memory capacity tends to be 

0 expensive and can require more complex management circuitry. The 
smaller number of bits per sample in the auxiliary channel 
represents a reduction in quantization resolution, or bandwidth, 
relative to the main signal, which is processed with 8-bit samples 
throughout. This effective reduction of bandwidth is not usually a 

1 problem when the auxiliary displayed picture is relatively small but 
can be troublesome if the auxiliary displayed picture is larger for 
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example the same size as the main displayed picture. Resolution 
processing circuit 370 can selectively Implement one or more 
schemes for enhancing the quantization resolution or effective 
bandwidth of the auxiliary video data. A number of data reduction 
5 and data restoration schemes have been developed, including for 
example, paired pixel compression and dithering and dedithering A 
dedithering circuit would be operatively disposed downstream of the 
video RAM 350. for example in the auxiliary signal path of the gate 
array, as explained in more detail below. Moreover, different 
10 dithering and dedithering sequences involving different numbers of 
bits and different paired pixel compressions involving different 
number of bits are contemplated. One of a number of particular data 
reduction and restoration schemes can be selected by the WSP ^lP in 
order to maximize resolution of the displayed video for each 
IS particular kind of picture display format. 

The luminance and color difference signals of the auxiliary 
signal are stored in an 8:1:1 six-bit Y. U .V fashion In a video RAM 
350 forming part of the picture-in-plcture processor. In other 
words, each component is quantized into six-bit samples. There are 
20 eight luminance samples for every pair of color difference samples 
Briefly, the picture-in-picture processor 320 is operated in a mode 
whereby incoming video data is sampled with a 640fH clock rate 
locked to the incoming auxiliary video synchronizing signal instead 
In this mode, data stored in the video RAM 350 is orthogonally 
25 sampled. When the data is read out of the picture-in-picture 
processor video RAM 350. it is read using the same 640fH clock 
locked to the incoming auxiliary video signal. However, even though 
this data was orthogonally sampled and stored, and can be read out 
orthogonally, it cannot be displayed orthogonally directly from the 
>o video RAM 350. due to the asynchronous nature of the main and 

auxiliary video sources. The main and auxiliary video sources might 
be expected to be synchronous only in that instance where they are 
displaying signals from the same video source. 

The main signal path 304, auxiliary signal path 306 and output 
's signal path 312 of the gate array 300 are shown in block diagram 
form in FIGURE 6. The gate array also comprises a ciocks/sync 
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Circuit 320 and a WSP nP decoder 310. Data and address output 
lines of the WSP iiP decoder 310. identified as WSP DATA are 
supplied to each of the main circuits and paths Identified above as 
well as to the picture-in-picture processor 320 and resolution 
processing circuit 370. It will be appreciated that whether or not 
certain circuits are. or are not. defined as being part of the gate 
array is largely a matter of convenience for facilitating explanation 
of the inventive arrangements. 

The gate array is responsible for expanding.- compressing and 
croppmg video data of the main video channel, as and if necessary 
to implement different picture display formats. The luminance 
component Y.MN is stored in a first in first out (FIFO) line memory 
356 for a length of time depending on the nature of the interpolation 
MA MKr'"^"""® component. The combined chrominance components 
U/V.MN are stored In FIFO 358. Auxiliary signal luminance and 
chrommance components Y.PIP. u_PIP and V PIP are developed by 
demultiplexer 355. The luminance component undergoes resolution 
processing, as desired, in circuit 357. and is expanded as necessary 
by interpolator 359, generating signal Y.AUX as an output. 

In some Instances, the auxiliary display will be as large as the 
mam signal display, as shown for example in FIGURE 1(d). The 
memory limitations associated with the picture-in-picture 
processor and video RAM 350 can provide an insufficient number of 
data points, or pixels for filling such a large display area. In those 
circumstances, resolution processing circuit 357 can be used to 
restore pixeis to the auxiliary video signal to replace those lost 
during data compression, or reduction. The resolution processing 
may correspond to the resolution processing undertaken by circuit 
370 shown in FIGURE 4. As an example, circuit 370 may be a 
dithering circuit and circuit 357 may be a dedithering circuit. 

The auxiliary channel is sampled at 640fH rate while the main 
channel is sampled at a 1024fH rate. The auxiliary channel FIFO 354 
converts the data from the auxiliary channel sample rate to the main 
channel clock rate. In this process, the video signal undergoes an 
8/5 (1024/540) compression. This is more than the 4/3 compression 
necessary to correctly display the auxiliary channel signal. 
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Therefore, the auxiliary channel must be expanded by the 
interpolator 359 to correctly display a 4 X 3 small picture. The 
interpolator 359 is controlled by Interpolator control circuit 371. 
which is itself responsive to WSP \iP 340. The amount of 
interpolator expansion required is s/g. The expansion factor X is 
determined as follows: 

X - (640/1024) • (4/3) - S/g 

The chrominance components U.PIP and V_PIP are delayed by 
circuit 367 for a length of time depending on the nature of the 
interpolation of the luminance component, generating signals U_AUX 
and V_AUX as outputs. The respective Y. U and V components of the 
main and auxiliary signals are combined in respective multiplexers 
315, 317 and 319 in the output signal path 312. by controlling the 
read enable signals of the FIFO's 354. 356 and 358. The multiplexers 
315. 317 and 319 are responsive to output multiplexer control 
circuit 321. Output multiplexer control circuit 321 is responsive to 
a clock signal, a start of line signal, a horizontal line counter signal, 
the vertical blanking reset signal and the output of the fast switch 
from the picture-in-picture processor and WSP jiP 340. The 
multiplexed luminance and chrominance components Y_MX. U_MX and 
V_MX are supplied to respective digital/analog converters 360, 362 
and 364 respectively. The digital to analog converters are followed 
by low pass filters 361, 363 and 365 respectively, shown in FIGURE 
4. The various functions of the pIcture-in-picture processor, the 
gate array and the data reduction circuit are controlled by WSP ^iP 
340. The WSP \iP 340 is responsive to the TV \iP 216, being 
connected thereto by a serial bus. The serial bus may be a four wire 
bus as shown, having lines for data, clock signals, enable signals and 
reset signals. The WSP |iP 340 communicates with the different 
30 circuits of the gate array through a WSP jiP decoder 310. 

In one case, it is necessary to compress the 4 X 3 NTSC video 
by a factor of 4/3 to avoid aspect ratio distortion of the displayed 
picture. In the other case, the video can be expanded to perform 
horizontal zooming operations usually accompanied by vertical 
35 zooming. Horizontal zoom operations up to 33% can be accomplished 
by reducing compressions to less than 4/3. A sample interpolator is 
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used to recalculate the incoming video to a new pixel positions 
because the luminance video bandwidth, up to 5.5 MHz for S-VHS 
format, occupies a large percentage of the Nyquist fold over 
frequency, which is 8 MHz for a 1024fH clock. 

As shown in FIGURE 6. the luminance data Y_MN is routed 
through an interpolator 337 in the main signal path 304 which 
recalculates sample values based on the compression or the 
expansion of the video. The function of the switches or route 
selectors 323 and 331 is to reverse the topology of the main signal 
path 304 with respect to the relative positions of the FIFO 356 and 
the interpolator 337. In particular, these switches select whether 
the interpolator 337 precedes the FIFO 356. as required for picture 
compression, or whether the FIFO 356 precedes the Interpolator 337 
as required for picture expansion. The switches 323 and 331 are 
responsive to a route control circuit 335. which is itself responsive 
to the WSP jiP 340. It will be remembered that the auxiliary video 
signal is compressed for storage in the video RAM 350, and only 
expansion is necessary for practical purposes. Accordingly, no 
comparable switching is required in the auxiliary signal path. 

In order to implement video compressions through the use of a 
FIFO, for example, every fourth sample can be inhibited from being' 
written into the FIFO 356. This constitutes a 4/3 compression It is 
the function of the interpolator 337 to recalculate the luminance 
samples being written into the FIFO so that the data read out of the 
FIFO is smooth, rather than jagged. Expansions may be performed in 
exactly the opposite manner as compressions. In the case of 
compressions the write enable signal has clock gating information 
attached to it in the form of Inhibit, pulses. For expanding data, the 
clock gating information is applied to the read enable signal. This 
30 will pause the data as it is being read from the FIFO 356. In this 
case it is the function of the interpolator 337. which follows the 
FIFO 356 during this process, to recalculate the sampled data from 
jagged to smooth. In the expansion case the data must pause while 
being read from the FIFO 356 and while being clocked into the 
35 interpolator 337. This is different from the compression case 

where the data is continuously clocked through the interpolator 337 
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For both cases, compression and expansion, the clock gating 
operations can easily be performed in a synchronous manner, that is 
events can occur based on the rising edges of the system clock 
1024fH. 

Interpolation of the auxiliary signal takes place in the 
auxiliary signal path 306. The PIP circuit 301 manipulates a 6 bit Y 
U, V. 8:1:1 field memory, video RAM 350. to store incoming video 
data. The video RAM 350 holds two fields of video data in a plurality 
of memory locations. Each memory location holds eight bits of data 
In each 8-bit location there is one 6-bit Y (luminance) sample 
(sampled at 640fH) and 2 other bits. These two other bits hold 
either fast switch data or part of a U or V sample (sampled at SOfw) 
The fast switch data values indicate which type of field was 
written into video RAM. Since there are two fields of data stored in 
the video RAM 350. and the entire video RAM 350 is read during the 
display period, both fields are read during the display scan. The PIP 
circuit 301 will determine which field will be read out of the 
memory to be displayed through the use of the fast switch data The 
PIP circuit always reads the opposite field type that is being 
written to overcome a motion tear problem. If the field type being 
read is the opposite type than that being displayed, then the even ' 
field stored in the video RAM is inverted by deleting the top line of 
the field when the field is read out of memory. The result is that 
the small picture maintains correct interlace without a motion tear. 

The clocks/sync circuit 320 generates read, write and enable 
signals needed for operating FIFOs 354. 356 and 358. The FIFOs for 
the main and auxiliary channels are enabled for writing data Into 
storage for those portions of each video line which is required for 
subsequent display. Data is written from one of the main or 
auxiliary channels, but not both, as necessary to combine data from 
each source on the same video line or lines of the display. The FIFO 
354 of the auxiliary channel is written synchronously with the 
auxiliary video signal, but is read out of memory synchronously with 
the main video signal. The main video signal components are read 
into the FIFOs 356 and 358 synchronously with the main video 
signal, and are read out of memory synchronously with the main 
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Video. How often the read function is switched back and forth 
between the main and auxiliary channels is a function of the 
particular special effect chosen. 

Generation of different special effects such as cropped side- 
5 by-side pictures are accomplished through manipulating the read and 
write enable control signals for the line memory FIFOs. The process 
for this display format is illustrated in FIGURES 7 and 8. In the case 
of cropped side-by-side displayed pictures, the write enable control 
signal (WR_EN_AX) for 2048 X 8 FIFO 354 of the auxiliary channel is 
10 active for (i/2)*(5/i2) - 5/,2 or approximately 41% of the display 
active line period (post speed up), or 67% of the auxiliary channel 
active line period (pre speed up), as shown in FIGURE 7. This 
corresponds to approximately 33% cropping (approximately 67% 
active picture) and the interpolator expansion of the signal by S/g. 
15 In the main video channel, shown in the upper part of FIGURE 8. the 
write enable control signal (WR_EN_MN_Y) for the 910 X 8 FIFOs 356 
and 358 is active for (Vzn^lz) - 0.67 or 67% of the display active 
line period. This corresponds to approximately 33% cropping and a 
compression ratio of 4/3 being performed on the main channel video 
20 by the 910 x 8. FIFOs. 

In each of the FIFOs, the video data is buffered to be read out 
at a particular point in time. The active region of time where the 
data may be read out from each FIFO is determined by the display 
format chosen. In the example of the side-by-side cropped mode 
25 shown, the main channel video is being displayed on the left hand 
half of the display and the auxiliary channel video is displayed on 
the right hand half of the display. The arbitrary video portions of 
the waveforms are different for the main and auxiliary channels as 
illustrated. The read enable control signal (RD_EN_MN) of the main 
channel 910 x 8 FIFOs is active for 50% of the display active line 
period of the display beginning with the start of active video, 
immediately following the video back porch. The auxiliary channel 
read enable control signal (RD_EN_AX) is active for the other 50% of 
the display active line period beginning with the falling edge of the 
RD_EN_MN signal and ending with the beginning of the main channel 
video front porch. It may be noted that write enable control signals 
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are synchronous with their respective FIFO input data (main or 
auxiliary, while the read enable control signals are synchronous 
with the main channel video. 

. Ho«- M ^ "^'^^'^^ '"'""^^ ^^^^^^ is particularly 

a side by side format. The display is particularly effective and 

lh.>h , ^ represented in a 4 X 3 format. 

10 rJJo NTSC ^2 X 9. Two 4X3 format display 

10 ratio NTSC pictures may be presented on the same 16 X 9 format 
display ratio display, either by cropping the pictures by 33% or 
squeezing the pictures by 33-/0. and introducing aspect ratio 
distortion. Depending on user preference, the ratio of picture 
cropping to aspect ratio distortion may be set any where in between 
IS the limits Of 0% and 33%. As an example, two side by side pictures 
may be presented as 1 6.7 % squeezed and 1 6.7% cropped 

The horizontal display time for a 16X9 format display ratio 

both hV' " ^'^P'^y display because 

.0 ^2.5 microsecond nominal 1^^^ Accordingly, an 

20 NTSC video signal must be sped up by a factor of 4/3 to preserve a 

correct aspect ratio, without distortion. The 4/3 factor is 

calculated as ratio of the two display formats: 
. - (1 6/9) / (4/3) 

Variable interpolators are utilized in accordance with aspects of 
IS this invention to speed up the video signals. In the past FIFOs 

havmg different clock rates at the inputs and outputs have been used 

to perform a similar function. By way of comparison, if two NTSC 

fnlo/T? ^'^"^'^ displayed on a single 4 X 3 

format display ratio display, each picture must be distorted or 
0 cropped, or some combination thereof, by 50%. A speed up 
comparable to that needed for a wide screen application is 
unnecessary. 

Generally, the video display and deflection system is 
synchronized with the main video signal. The main video signal mu- 
5 be speeded up. as explained above, to fill the wide screen display 
The auxiliary video signal must be vertically synchronized with the 
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f.rst video signal and the video display. The auxiliary video signal 
can be delayed by a fraction of a field period in a field memory and 
then expanded in a line memory. Synchronization of the auxiliary 
video data with main video data is accomplished by utilizing the 
5 video RAM 350 as a field memory and a first in first out (FIFO) line 
memory device 354 for expanding the signal. 

The asynchronous nature of the read and write clocks 
however, does require that steps be undertaken to avoid read/write 
pointer collisions. Read/write pointer collisions occur when old 
10 data is read out of the FIFO before new data has an opportunity to be 
written into the FIFO. Read/write pointer collisions also occur 
when new data overwrites the memory before the old data has an 
opportunity to be read out of the FIFO. The size of the FIFO is 
related to the minimum line storage capacity thought to be 
15 reasonably necessary to avoid read/write pointer collisions 

The picture-in-picture processor operates in such a manner 
that the auxiliary video data is sampled with a 640fH clock locked to 
the horizontal synchronizing component of the incoming auxiliary 
video signal. This operation enables orthogonally sampled data to be 
20 stored in the video RAM 350. Data must be read out of the video RAM 
at the same 640fH rate. The data cannot be orthogonally displayed 
from the video RAM without modification due to the generally 
asynchronous nature of the main and auxiliary video sources In 
order to facilitate synchronization of the auxiliary signal to the 
2s mam signal, a line memory with independent write and read port 

videoVAM'^SSr*** ^"'''"^'^ ^^^^ °' 

More particularly, as shown in FIGURE 4, the output of the 
video RAM 350 is an input to the first of two 4.bit latches 352A and 

0 352B. The VRAM_OUT output is in 4.bit data blocks. The 4-bit ' 
latches are used to recombine the auxiliary signal back into 8-bit 
data blocks. The latches also reduce the data clock rate from 
l280fH to 640fH. The S-blt data blocks are written into the FIFO 
354 by the same 640fH clock used to sample the auxiliary video data 

5 for storage in the video RAM 350. The size of FIFO 354 is 2048 X 8 
The S-bit data blocks are read out of the FIFO 354 by the 1024fH 



BNSDOCID:<WO 9119378A1> 



wo 91/19378 




PCr/US91/03822 



display clock, which is locked to the horizontal synchronizing 
component of the main video signal. This basic configuration, which 
uses a multiple line memory with independent read and write port 
clocks, enables data which was orthogonally sampled to be displayed 
orthogonally. The 8-bit data blocks are divided into 6-bit luminance 
and color difference samples by demultiplexer 355. The data 
samples may then be interpolated as necessary for the desired 
format display ratio and written as video data output. 

Since the reading and writing of data from the auxiliary 
channel FIFO is asynchronous, and the read clock rate is considerably 
faster than the write dock rate, there is the possibility of 
read/write pointer collisions. A read/write pointer collision occurs 
when a read enable signal is received before old data, that has 
already been read previously, has been replaced by newly written 
data. Interlace integrity must also be preserved. A sufficiently 
large memory must be chosen in the first instance in order to avoid 
read/write pointer collision in the auxiliary channel FIFO. 

It is a particular advantage of wide format display ratio 
televisions that letterbox signals can expanded to fill the wide 
format display ratio display screen, although it may be necessary to 
interpolate the signal to provide additional vertical resolution. In 
accordance with an aspect of the invention, an automatic letterbox 
detection circuit is provided, which automatically implements 
expansion of the 4 x 3 format display ratio signal which includes the 
25 16 X 9 format display ratio letterbox display. 

In order to increase the vertical height of the letterbox signal, 
the vertical scan rate of display video is increased so that the black 
regions at the top and bottom of the picture are eliminated, or at 
least substantially reduced. An automatic letterbox detector can be 
30 based on the assumption that the video signal will have no active 
video, that is, a substantially constant luminance value not higher 
than a threshold value. Alternatively, letterbox detection can be 
accomplished by calculating two gradients for each line in the video 
field. Four values are required to calculate the two gradients: 
35 maximum and minimum values of the current line, and maximum anc 
minimum values of the previous line. The first gradient, designated 



20 



BNSDOCID: <WO 9119378A1> 



wo 91/19378 




PCT/US91/03822 



the positive gradient, is formed by subtracting the minimum value of 
the previous line from the maximum value of the current line. The 
second gradient, designated the negative gradient, is formed by 
subtracting the minimum value of the current line from the 
5 maximum value of the previous line. Either of the gradients may 
have positive or negative values depending on scene content, but the 
negative values of both gradients may be ignored. This is because 
only one gradient may be negative at a time, and the magnitude of 
the gradient with the positive value will always be greater than or 
10 equal to the magnitude of the gradient with the negative value. This 
simplifies the circuitry by eliminating the need to calculate an 
absolute value of the gradients. If either gradient has a positive 
value which exceeds a programmable threshold, video is considered 
to be present on either the current line or on the previous line. 
15 These register values can be used by a microprocessor to make a 
determination of whether or not the video source is in the letterbox 
format. 

In yet another alternative, not illustrated in the drawings, the 
automatic letterbox detector may comprise a circuit for decoding a 

20 code word or signal carried by a letterbox signal source which 
identifies the signal as letterbox format. 

FIGURE 12 illustrates an automatic letterbox detector as part 
of a vertical size control circuit 1030. The vertical size control 
circuit comprises a letterbox detector 1032, a vertical display 

25 control circuit 1034 and a 3-state output device 1036. 

Alternatively, the vertical blanking and vertical reset pulses can be 
transmitted as separate signals. In accordance with an inventive 
arrangement, the automatic letterbox detection circuit can 
automatically implement vertical zoom or expansion of the 4 x 3 

30 format display ratio signal which includes the 16 x 9 format display 
ratio letterbox display. When the output signal VERTICAL SIZE ADJ 
becomes active, the vertical deflection height is increased by 4/3 
(see FIGURE 10). which enables the active video portion of the 
letterbox signal to fill the wide screen without image aspect ratio 

35 distortion. 
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The vertical display control circuit 1034 also controls which 
part of the overscanned raster will be displayed on the screen a 
feature referred to as vertical panning. If the vertically 
overscanned video signal is not in letterbox format, the conventional 
5 display format picture can be zoomed, that is expanded, to simulate 
a wide screen format In this case, however, the portions of the 
picture cropped by the 4/3 vertical overscan will contain active 
video information. It Is necessary to vertically crop 1/3 of the 
picture. Absent further controls, the top and- bottom 1/5 will 
10 a ways be cropped. However, picture content may dictate that more 
of the top than the bottom of the picture is better cropped or vice 
versa. If all action is at ground level, for example, a viewer might 
prefer to crop more sky. A vertical panning capacity enables a 
choice as to which part of the zoomed picture will be shown and 
15 which part will be cropped. 

Vertical panning is explained with reference to FIGURES 13 and 
I4(a)-{c). The three level composite vertical blanking/reset signal 
■s Shown at the top of FIGURE 13. These signals can be generated 
separately. The vertical blanking pulse begins when the signal 
" woT^n^"^ ^° VR'T-BLNKO and ends when L.COUNT is equal to 

VRT_BLNK1 . The vertical reset pulse starts when L_COUNT is equal 
to VRT.PHASE and lasts for 10 horizontal lines. The L_COUNT is the 
output of a ten bit counter used to keep track of horizontal half lines 
with respect to the leading edge of VSYNC_MN. VSYNC_MN is the 
25 synchronized version of VDRV_MN. which is the vertical 

synchronizing component of the main signal provided to the gate 
array. VRT.BLNKO and VERT_BLNK1 are provided by the 
microprocessor depending upon the vertical panning command 
VRT.PHASE programs the relative phase of the VERT_RST output 
>o with respect to the rising edge of the vertical synchronizing 

component in the COMP.SYNC output. The COMP_SYNC output is the 
output of a J-K flip/flop. The state of the flip[/flop is determined 
by decoding the outputs of L.COUNT and H_COUNT. H_COUNT is the 
horizontal position counter. The L.COUNT counter is used to 
s segment the COMP_SYNC signal into three segments corresponding to 
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the horizontal synchronizing pulse, the equalization pulse and the 
vertical synchronizing pulse. 

A vertical deflection current for no overscan, which actually 
refers to the normal 6% overscan, is shown by dotted lines, as is the 
5 corresponding vertical blanking signal. The width of the vertical 
blankmg pulse for no overscan Is C. The vertical synchronizing pulse 
IS in phase with the vertical reset pulse. A vertical deflection 
current for the overscan mode is shown by a solid line, as is the 
corresponding vertical blanking pulse, having pulse width D 
10 If the bottom overscan A is equal to the top overscan B the 

display will be as shown In FIGURE 14(a). If the vertical reset pulse 
IS generated so as to lag the vertical synchronizing pulse the 
bottom overscan A Is less than the top overscan B. resulting in the 
display shown In FIGURE 14(b). This is a downward vertical pan 
> 5 displaying the lower part of the picture and blanking the top third of 
the picture. Conversely, if the vertical reset pulse Is generated so 
as to lead the vertical synchronizing pulse, the bottom overscan A is 
more than the top overscan B. resulting in the display shown In 
FIGURE 14(c). This Is an upward vertical pan. displaying the upper 
0 part of the picture and blanking the bottom third of the picture The 
relative phase of the vertical synchronizing signal and the vertical 
reset signal Is controllable by the WSP jiP 340. to enable vertical 
panning during overscan modes of operation. It will be appreciated 
that the overscanned raster remains vertically centered or 
5 symmetric, on the picture tube or screen during vertical panning it 
IS the blanking Interval which can be vertically moved or 
positioned, asymmetrically with respect to the center 'of the raster 
so as to blar^k more of the picture at the top than the bottom, or vice 
versa. 
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What is claimed is: 

1 1. A display system, comprising: 

2 video display means: 

3 means for mapping on said video display means an adjustable 

4 picture display area represented in a video signal having a 

5 synchronizing component; 

6 means for selectively enlarging said picture display area 

7 relative to said video display means; and, 

8 means for controlling in phase a blanking interval relative to 

9 said synchronizing component to control which portion of said 
1 0 enlarged picture area is displayed and which portion is not 

Ti displayed. 

1 2. The system of claim 1 , wherein said picture display area is 

2 adjustable vertically, said synchronizing component is a vertical 

3 synchronizing component and said blanking interval is a vertical 

4 blanking area. 

1 3. The system of claim 2, wherein said video display means 

2 and said picture represented in have different format display ratio's. 

1 4. The system of claim 1 , wherein said video display means 

2 and said picture represented in said video signal have different 

3 format display ratios. 

1 5. The system of claim 4, wherein said format display ratio 

2 of said video display means is wider than said format display ratio 

3 of said picture represented in said video signal. 
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